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ABSTRACT 

A Test/Score/Report capability is currently 
being developed for the Transportable Payload 
Operations Control Center (TPOCC) 
Advanced Spacecraft Simulator (TASS) sys- 
tem which will automate testing of the God- 
dard Space Flight Center (GSFC) Payload 
Operations Control Center (POCC) and Mis- 
sion Operations Center (MOC) software in 
three areas: telemetry decommutation, space- 
craft command processing, and spacecraft 
memory load and dump processing. Auto- 
mated computer control of the acceptance test 
process is one of the primary goals of a test 
team. With the proper simulation tools and 
user interface, the task of acceptance testing, 
regression testing, and repeatability of specific 
test procedures of a ground data system can be 
a simpler task. Ideally, the goal for complete 
automation would be to plug the operational 
deliverable into the simulator, press the start 
button, execute the test procedure, accumulate 
and analyze the data, score the results, and 
report the results to the test team along with a 
go/no go recommendation to the test team. In 
practice, this may not be possible because of 
inadequate test tools, pressures of schedule, 
limited resources, etc. Most tests are accom- 
plished using a certain degree of automation 
and test procedures that are labor intensive. 
This paper discusses some simulation tech- 
niques that can improve the automation of the 
test process. 


The TASS system tests the POCC/MOC soft- 
ware and provides a score based on the test 
results. The TASS system displays statistics 
on the success of the POCC/MOC system pro- 
cessing in each of the three areas as well as 
event messages pertaining to the Test/Score/ 
Report processing. The TASS system also 
provides formatted reports documenting each 
step performed during the tests and the results 
of each step. A prototype of the Test/Score/ 
Report capability is available and currently 
being used to test some POCC/MOC software 
deliveries. When this capability is fully opera- 
tional it should greatly reduce the time neces- 
sary to test a POCC/MOC software delivery, 
as well as improve the quality of the test pro- 
cess. 

1. INTRODUCTION 

1.1 TASS Background 

The Transportable Payload Operations Control 
Center (TPOCC) Advanced Spacecraft Simu- 
lator (TASS) system has been designed to sup- 
port the development, test, and operational 
aspects of Payload Operations Control Center 
(POCC) and Mission Operations Center 
(MOC) software deliverables. TASS is 
designed to test the majority of POCC/MOC 
low-level requirements. The TASS system 
simulates spacecraft telemetry and command 
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functions. TASS takes advantage of the 
TPOCC architecture by using the backup 
POCC/MOC system configuration hardware 
for the simulator, or TASS can be separately 
hosted on a streamlined version of the POCC/ 
MOC. This eliminates the need to schedule 
hardware or Nascom lines during various test 
configurations. In essence, the user has a sim- 
ulator on call at all times. 

TASS has the capability to simulate the 
Nascom link protocols required to support sat- 
ellites and generate simulated spacecraft 
telemetry streams using the POCC’s/MOC’s 
operational data base (ODB). TASS validates 
spacecraft commands and alters the real-time 
telemetry stream in response to those com- 
mands. The user can alter the telemetry stream 
either by data base mnemonic or by specifying 
individual bits in the telemetry frame or 
packet. Similar telemetry display pages at 
both the simulator workstation and the POCC/ 
MOC workstation help identify telemetry pro- 
cessing irregularities. As part of the system 
design, software hooks are available so more 
complexity can be added by providing various 
dynamic models for the telemetry generating 
function. 

In the POCC/MOC test environment, the 
TASS system provides a means for saving and 
restoring predefined test scenarios and results, 
telemetry stream contents, and data structures 
to allow the user to accurately repeat specific 
tests, retest with known data, or continue test- 
ing from a given point in the test scenario. 
These features allow the user to perform 
regression tests on new software deliverables 
in the shortest possible time. 

TASS records all received Nascom blocks and 
all received spacecraft commands in history 
files that can be viewed for detailed analysis 
through the use of an offline utility program. 
All system events, errors, operator input, pro- 
cedure input recorded in the event log; and 
spacecraft memory images that are saved can 
be viewed by using the offline utility pro- 
grams. After completing the test, the user gen- 
erates test reports using the report generation 
subsystem. These reports can later be used to 
evaluate the test results during the analysis 
process. 


Unique implementations of spacecraft memory 
load and dump capabilities are provided as 
well as an NCC communications protocol 
when TDRSS support is required. 

1.2 TASS System Design 

A typical POCC/MOC system string is used to 
host the TASS software. The hardware config- 
uration to support TASS consists of two com- 
puters connected by Ethernet and associated 
peripherals as shown in Figure 1. These com- 
puters are a real-time front-end computer or 
processor (FEP) in a Versa Module European 
(VME) bus enclosure and a general-purpose 
computer or workstation. The real-time FEP is 
used to process spacecraft commands and to 
build and transmit telemetry streams. The 
Hewlett-Packard HP 9000-715 workstation 
allows the user to configure, control, and mon- 
itor the FEP from one or more user terminals. 

TASS makes extensive use of the same 
TPOCC reusable software that the POCC/ 
MOC developers use, mainly the user interface 
(display and TPOCC Systems Test and Opera- 
tions Language (TSTOL)) and the Nascom 
interface. The display system is based on X 
Windows and fully adheres to the industry- 
standard OSF/Motif principles. TSTOL is the 
user script language which is used to control 
the TPOCC application system (either the 
POCC/MOC system or the TASS system). 
TSTOL is also used to develop operational 
scenarios and test procedures. Presently, 
TPOCC reusable software comprises approxi- 
mately 78% of the TASS system. Another 
16% of TASS is reusable from mission to mis- 
sion, such that only about 6% of TASS needs 
to be newly developed with each added POCC/ 
MOC mission. 

1.3 Control Center Configuration 

Because of the methodology chosen for the 
overall ground system design, no special 
equipment or system configuration is required 
for TASS. TASS uses the POCC/MOC backup 
system string and communicates with the pri- 
mary POCC/MOC system string thru the local 
TPOCC switch. In a test configuration, the 
TASS input/output data flow at the switch 
interface looks like the Nascom interface to the 
primary POCC/MOC system string. This 
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architecture is shown in Figure 2. 

The TASS system accepts spacecraft com- 
mands from the POCC/MOC and transmits 
telemetry to the POCC/MOC via Nascom con- 
nections on both FEPs. The workstations 
show displays generated by the TASS and 
POCC/MOC system. 

2. GROUND DATA SYSTEM TESTING 

2.1 Software Delivery Test Process 

GSFC Control Center Systems Branch is 
responsible for testing the software deliver- 
ables for the POCC/MOC systems in the 
TPOCC environment. TPOCC based POCCs/ 
MOCs support the WIND, POLAR, 
SAMPEX, FAST, SWAS, SOHO, XTE, 
TRMM, and ACE missions. Testing of these 
POCC/MOC systems consists of unit testing, 
integration testing, and finally acceptance test- 
ing. 

Unit testing is performed throughout the soft- 
ware implementation phase by the POCC/ 
MOC developers. Unit testing is completed 
prior to delivery of the unit for system integra- 
tion. 

Integration testing is performed before deliv- 
ery to the test team. This testing verifies inte- 
gration of TPOCC generic software and 
POCC/MOC unit software into the POCC/ 
MOC system and is performed by an integra- 
tion manager who is supported by the develop- 
ment team. 

Acceptance testing is performed by the test 
team before delivery to GSFC according to a 
comprehensive test plan and procedures. This 
testing verifies the functional and performance 
requirements and is completed prior to deliv- 
ery of the system to operations/user commu- 
nity. 

2.2 Automating the Test Process 

To achieve the goal of automating the test pro- 
cess, several test methodologies have been 
prototyped. The most promising concept is 
Test/Score/Report. TASS and POCC/MOC 
simularities in system architecture, user inter- 
face, script language, and project data base 


files are some elements that support this sys- 
tem concept approach to automate the test pro- 
cess. 

3. TEST/SCORE/REPORT 

3.1 Automated Testing in Three Areas 

The Test/Score/Report capability currently 
being developed will automate testing of the 
POCC/MOC software in three areas: teleme- 
try decommutation, spacecraft command pro- 
cessing, and spacecraft memory load and 
dump processing. TASS takes advantage of 
the ground system attributes in designing the 
Test/Score/Report capabilities. Both the TASS 
and the POCC/MOC systems are using some 
of the same reusable building blocks of 
TPOCC software and running on the same 
hardware architecture. By using this approach, 
TASS can easily add features which enhance 
the automated test process. 

Figure 3 shows the data and control flows 
between the two systems. The TASS system 
simply establishes a socket connection with 
the POCC/MOC system in order to make 
requests for data and to receive the data. This 
connection is transparent to the POCC/MOC 
system and requires no new software be writ- 
ten on the POCC/MOC side. The TASS sys- 
tem also reads the POCC’s/MOC’s system 
variable dump file and the ground image file 
which both reside on the workstation’s disk. 
The system variable dump file contains all of 
the telemetry parameters located in the opera- 
tional data base as well as counters and status 
information. This file is needed for initializa- 
tion purposes before requests for data can be 
made. The ground image file is used to vali- 
date spacecraft memory load and dump pro- 
cessing. 

Telemetry decommutation is tested in two 
ways. The first way is by comparing the val- 
ues of telemetry parameters decommutated by 
the POCC/MOC against the telemetry parame- 
ters commutated by TASS. Ideally, the 
decommutated values should match the com- 
mutated values. The second way is by com- 
paring the limit specifications previously set 
with the status words of decommutated telem- 
etry parameters. Every telemetry parameter 
located in the operational data base is automat- 
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Figure 3. Data/Control Flow Between TASS and the POCC/MOC 


ically checked. Each discrepancy is displayed 
as an event message which gives the value of 
the decommutated telemetry parameter and the 
value of the commutated telemetry parameter. 
Summary event messages for the two teleme- 
try decommutation tests state the total number 
of telemetry parameters which decommutated 
correctly, the total number of telemetry param- 
eters checked, and the percentage of which 
were correctly decommutated. 

For spacecraft commanding, the test process 
validates the various fields in the Nascom 
block header for all spacecraft command 
blocks received by TASS and validates the 
individual spacecraft commands received in 
valid command blocks. TASS also checks 
whether the POCC/MOC verified the com- 
mands after they were executed by TASS. 
This is accomplished by making data requests 
to the POCC/MOC for values of command sta- 
tus parameters and counters. Summary event 
messages are displayed which give the number 
of valid command blocks, the number of valid 
commands, the number of commands verified 
by the POCC/MOC, and the percentages for 
each of the above tests. 

The spacecraft memory load and dump pro- 
cessing is tested by comparing the spacecraft 
image maintained by TASS against the ground 
image file maintained by the POCC/MOC. 
This test is performed after memory load data 
is sent to TASS from the POCC/MOC via a 
spacecraft command and after TASS transmits 
a memory dump to the POCC/MOC via the 


telemetry stream. Ideally, the memory values 
maintained by TASS should match values in 
the POCC/MOC ground image file. A sum- 
mary event message informs the user of the 
number of bytes that miscompared, the total 
number of bytes in the spacecraft image, and 
the percentage of bytes which had the same 
value. 

3.2 Scoring the Ground Data System 

The initial scoring method will be in terms of 
percentages and raw counts. More experience 
in testing and interpreting the test results will 
be required to develop a better scoring meth- 
odology. 

3.3 Reporting the Test Results 

The TASS system displays statistics on the 
success of the POCC/MOC in each of the three 
areas as well as event messages pertaining to 
the Test/Score/Report processing. The Test/ 
Score/Report display page shown in Figure 4 
is broken up into two sections. The top section 
gives the summary counts and scores for the 
various tests. The bottom section is a scrolling 
region which displays all event messages gen- 
erated during Test/Score/Report processing. 

The TASS system also provides formatted 
reports documenting each step performed dur- 
ing the tests and the results of each step. The 
user can issue reports for each type of test (i.e., 
telemetry, limits, command, memory loads/ 
dumps). Report options include showing all 
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159-17:44:32.7 
159-17:44:32.7 
159-17:45:42.5 




17013 2 valid command blocks out of 2 were sent by 5UIAS POCC. Score = 100% correct. 

17014 11 valid commands out of 11 were sent by SUA5 POCC. Score = 100% correct. 

17015 11 commands out of 0 were validated by 5UIAS POCC. Score = -1% correct. 

17101 145 SCS byte miscompares found out of 333 total bytes. Score = 56% correct. 


Figure 4. Test/Score/Report Display Page 


parameters tested or just those parameters 
which miscompared or were in error. For 
telemetry tests, the report shows the telemetry 
mnemonic, the commutated value, and the 
decommutated value. For limit tests, the 
report shows the telemetry mnemonic, the 
commutated value, the limit specification and 
the status word of the decommutated parame- 
ter, and the decommutated value. For com- 
mand tests, the report shows numbers of: 
Nascom block header errors, command errors, 
and commands verified. Finally, for memory 
load/dump tests, the report shows the memory 
address, TASS’s spacecraft image value, and 
the POCC’s/MOC’s ground image value. 

4. PRESENT STATUS 

A prototype of the Test/Score/Report capabil- 
ity is available and currently being used to test 
the WIND, POLAR, SAMPEX, FAST, SWAS, 
and SOHO POCC software deliveries and the 
XTE MOC software delivery. This prototype 
includes the “test” and “score” features 
described in this paper. The “report” features 
(other then the Test/Score/Report display 
page) are currently being developed by the 
TASS development team and are planned to be 
released by early next year. The TASS devel- 
opment team is actively working with the 
POCC/MOC test team and software develop- 
ers to obtain feedback on the Test/Score/ 
Report prototype. 


5. FUTURE DIRECTIONS 

Basically we have completed our prototyping 
stage of this project. We have been successful 
in implementing this methodology in several 
projects as mentioned in the previous section. 
Future objectives are to automate more of the 
test process by: 1) including additional 

subsystem testing such as attitude, events, 
packet extraction, history, NCC, and database 
testing; 2) improving the scoring 
methodology; and 3) providing more 
functionality and options for the report 
process. 
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